Imaging Science Divisi@ii$r£/c rfl) 
Technical Memorandum^*? 




Security Classification (check one) 

Confidential Information/Controlled Distribution 

VW Restricted Information 
Unrestricted Internal Use 



Title: 

Author: 

Group/Lab: 

Contributors: 

Date: 

ISD Number: 



Optimum MTF of a Digital Camera Anti- Aliasing (Blur) Filter 



James E. Adams, Jr. 



Input/Output Processing Group 



08/30/1996 
734-96012 



ABSTRACT: 

This memo pulls together elements from several of my digital camera documents to attempt to answer 
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KODAK MEMO 

August 30, 1996 
FROM: Jim Adams 

TO: John Hamilton, Dave Kessler, Rodney Miller, Les Moore, Jim Mruk, Steve 
Noble, Ken Parulski, Joe Revelli, Steve Smith, Kevin Spaulding 
SUBJECT: Optimum MTF of a Digital Camera Anti-Aliasing (Blur) Filter 

This memo pulls together elements from several of my digital camera documents 
to attempt to answer the question of what is the optimum MTF of a digital 
camera anti-aliasing (or, blur) filter. While I state some conclusions for the first 
time in print in this document, I believe these statements are already existing in 
my previous works, if only between the lines. As such, I believe nothing very 
new is presented here. 

This document has not received the same technical scrutiny from colleagues as 
my other works. Therefore, please feel free to discuss with me any points that do 
not seem clear or consistent. In terms of document control, I will probably bundle 
this memo with a few other ones I have written this year as a technical report 
near the end of the year. The version released in the technical report will 
incorporate any improvement made upon this work in the interim. 

Bayer Pattern Sampling 

In the Kodak Memo "Aliasing Analysis of Kodak Bayer Color Filter Array 
Pattern" 1 , and Kodak Technical Reports "Edge Sharpening in Kodak Digital 
Cameras" 2 and "The Karnak CFA Interpolation Algorithm" 3 , 1 develop a theory 
of signal sampling and recovery for the Bayer pattern along the lines presented 
by J. D. Gaskill in his book "Linear Systems, Fourier Transforms, and Optics" 4 . 
To summarize, consider the Bayer pattern superimposed on a Cartesian 
coordinate system in Fig. 1. 
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szmp G (x,y) = ^-comb 



I 2 ' 2 J 



samp B (x,;y) = ^combf | 



The Fourier transforms of Eqs. 1, 4 and 5 are, respectively, 

Samp R (£, r\) = e- y2 ^comb(2^,2r/) 
Samp G (£, r?) = comb(<f; + ti,-% + r?) 
Samp B (£, 77) = e" J ' 2,nj comb(2|,2T7) 



(4) 



(5) 



(6) 
(7) 
(8) 



Plots of the absolute values of Eqs. 6, 7 and 8 will show the location, in frequency 
space, of the signal fundamental = 0, r\ = 0) and of all the potential harmonics. 
Figure 2 is a plot of I Sampan) I = I SampB&r)) I and Fig. 3 is a plot of 
ISampc(£,Tl)l. 
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Figure 2. Plot of I SampR(4,T|) I = I Sampe^T)) I . The axes are labeled in units of 

cycles/sample. 
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Figure 4. Plot of Ideal Anti- Aliasing Filter for Red and Blue Channels. The axes 

are labeled in units of cycles /sample. 
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among the three color channels. A simplifying assumption is that the vast 
majority of the lu'minance is contained in the green channel and that the 
remaining amounts in the red and blue channels can be ignored. Like all 
engineering approximations, this assumption is not entirely true and changes 
from application to application. However, it will serve well enough here. If we 
assume all the important luminance information is contained in the green 
channel, then we can describe a filter that blurs each channel equally and has a 
frequency response of Eq. 10. Such a filter will prevent aliasing due to Bayer 
pattern sampling. 

Color Filter Array Interpolation 

A tacit assumption made by the previous section is that all subsequent image 
processing is perfect with respect to spatial detail. Unfortunately, this is not the 
case. Color filter array (CFA) interpolation can produce significant artifacts in the 
reconstructed luminance of the image. Therefore, the design of the anti-aliasing 
filter must take this into account in order to avoid producing colored pixel 
artifacts as a result of CFA interpolation. 

In the aforementioned "Edge Sharpening in Kodak Digital Cameras" 2 and 'The 
Karnak CFA Interpolation Algorithm" 3 and in the Kodak Imaging Science 
Division Technical Memorandum "MTF of CFA Interpolation Kernels" 5 , 1 derive 
analytical expressions for the modulation transfer function (MTF) of a number of 
CFA interpolation algorithms used in Kodak digital cameras. In general the MTF, 
Intp(^), of the entire class of CFA interpolation kernels used in Kodak Bayer 
pattern digital cameras can be described by Eq. 13. 

Intp(§) = cos 2 (^) + Jtsin 2 (2^) (13) 

The value k in Eq. 13 is different for each of the algorithms used. Table 1 
summarizes appropriate values for k for a number of Kodak digital cameras. 



Table 1. Values of k for Equation 13 for a Number of Kodak Digital Cameras. 



k 


Algorithm 


Camera 


0 


Hibbard 
Laroche-Prescott 


QuickTake 100 
DCS-200 
DCS-420 


1/2 


AH2 (Adams-Hamilton) 


DC40 
DC50 


1/3 


Karnak (Adams-Hamilton) 


(none yet) 



Figure 6 is a plot of Eq. 13 for the values of k listed in Table 1. 
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Table 2, Values of ki, k 2 and k 3 for Equation 14 for a Number of Kodak CFA 
Interpolation Algorithms. 



ki 


k 2 


k 3 


Algorithm 


1 


0 


0 


Hibbard 


0 


1/2 


0 


Laroche-Prescott 


1/3 


1/3 


0 


AH2 (Adams-Hamilton) 


2/5 


1/5 


1/5 


Karnak (Adams-Hamilton) 



Figure 7 is a plot of Eq. 14 for the values of ki, k 2 and k 3 listed in Table 2. 




£ (cyc/samp) 



Figure 7. MTF of Various CFA Interpolation Classifiers Used in Kodak Digital 

Cameras 

With the exception of the Karnak algorithm, it can be seen in Fig. 7 that there are 
two frequency ranges where the MTF drops below 20% modulation: near zero 
and near 0.5 cycles /sample. This means the classifier cannot tell whether a field 
of one pixel wide stripes (i.e., 0 cycles/sample in one direction and 0.5 
cycles/sample in the orthogonal direction) is oriented horizontally or vertically. 
Also, at these frequencies the classifier value can be smaller than the level of 
noise in the image, resulting in random adaptive decisions. These effects are 
generally the sources of most colored pixel artifacts produced by the Hibbard, 
Laroche-Prescott and AH2 CFA interpolation algorithms. (There are advantages 
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(18) 



A two dimensional version would be (compare to Eq. 10): 

Blur.^.rj) = trap(£ - r?,£ + 77;0.25,0. 4,0.25,0. 4) (19) 

where 

trap(jc -x 0 ,y-y 0 \b l ,b 2 ,d l ,d 2 ) = trap(x - x 0 ,fc 2 )trap(;y - y 0 , ^) (20) 

(A subtle point to note is that Bluri(£,0) of Eq. 19 is not equal to Bluri(^) of Eq. 15, 
but Bluri 2 (^). This is not a significant difference in this discussion.) 

Image simulation suggests that most important part of Eq. 15 is the region 0.4 
cycles/sample and higher. Empirically, an approximation of Eq. 15, Blur s (p), that 
can be easily implemented in image simulation is given in Eq. 21. 

Blur s (p) = Gaus^) (21) 

where 



Gaus 



exp 



(22) 



and p is a frequency space radius (polar coordinates) in units of cycles/ sample. 
In Photoshop, Eq. 21 is equivalent to a Gaussian blur with a radius of 0.8. Figure 
8 is a plot of Eqs. 15 and 21. 
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The lower right image was generated using AH2 and Photoshop to apply a 
Gaussian blur with a radius of 0.8 pixels. The visibility of the remaining colored 
pixel artifacts is very low. 
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Figure 9. Upper Left: Original, Upper Right: DC50 Quartz Blur Filter, Lower Left: 1 2 1 Blur Filter, Lower Right: Gaus Blur Filter 



